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We propose an holographic microscopy reconstruction method, which propagates the hologram, in 
the object half space, in the vicinity of the object. The calibration yields reconstructions with an 
undistorted reconstruction grid i.e. with orthogonal x, y and axis and constant pixels pitch. The 
method is validated with an USAF target imaged by a x60 microscope objective, whose holograms 
are recorded and reconstructed for different USAF locations along the longitudinal axis: -75 to +75 
/xm. Since the reconstruction numerical phase mask, the reference phase curvature and MO form an 
afocal device, the reconstruction can be interpreted as occurring equivalently in the object or in image 
half space. 

OCIS codes: (090.1995) Holography: Digital holography, (110.0180) Imaging systems: Mi¬ 

croscopy, (170.7050) 
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1. Introduction 

In Digital Holography, a camera records the inter¬ 
ference pattern of the object field wavefront with a 
known coherent reference beam. This digital holo¬ 
gram is then used to reconstruct numerically the 
image of the object by back propagating the mea¬ 
sured object field wavefront from the hologram to 
the object [H]. Many methods have been proposed 
to reconstruct the holographic image in free space 
[^, like single Fourier transform method [H, plane 
wave e^ansion method with two Fourier trans¬ 
forms U, or adjustable magnification method 0]. 
Although digital holographic microscopy is exten¬ 
sively used [Sl-llOl]. very few papers describe the re¬ 
construction procedure that must be used in holo¬ 
graphic microscopy. 
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Montfort et al. 0 proposed a holographic mi¬ 
croscopy reconstruction algorithm, in which the 
field is propagated in free space from the camera 
to the image of the object (conjugate of the object 
by the microscope objective MO) [n|-0. Various 
methods can be used then to compensate for the 
phase curvature of the lens, and for the tilt angle of 
off-axis holography. Ferraro et al. 0 use a refer¬ 
ence hologram as phase mask. Montfort et ah, and 
Colomb et al. [Ill, [13-lil use a calculated phase 
mask that is defined by its Zernike polynomial ex¬ 
pansion, where coefficients are adjusted to optimize 
the contrast of the image. Residual phase distor¬ 
tions can be then compensated by using a Zernike 
phase mask located in the plane of the object. In 
most cases, these methods have been used to mea¬ 
sure the phase of “flat objects”, e.g. a biologic sam¬ 
ple between slide and cover slide or a micro lens de¬ 
vice @- 1 , 111 , 0 . These methods are well adapted 
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Fig. 1. Typical holographic microscopy setup. USAF: 
USAF target located in plane O’; MO: microscope objec¬ 
tive that images the USAF target in plane O; BSl, BS2: 
beam splitters; M: mirror. E and Er: signal and refer¬ 
ence fields; Note that BS2 is angularly tilted in order to 
perform off axis holography. 


to such cases, owing to these great efforts to com¬ 
pensate phase distortions and get a precise phase 
reference. 

To illustrate reconstruction, let us consider a typ¬ 
ical holographic microscopy setup (see Fig. [T]). The 
object is located in plane O’ and is imaged by the 
microscope objective MO in plane O. The camera 
located in plane C records the hologram H that is 
the interference pattern of the signal field E with 
the reference field Er. The purpose is to recon¬ 
struct the amplitude and the phase of the field scat¬ 
tered by the object in the object plane O’, and near 
this plane (if the object is thick or if one want to 
measure the wave field). Before making reconstruc¬ 
tion, one need to calibrate the setup to get the re¬ 
construction parameters, which depends on the op¬ 
tical elements in the image half space: location of 
MO, BS2 and camera, BS2 angular tilt and direc¬ 
tion and curvature of the reference beam (i.e. loca¬ 
tion of point R). Once the calibration of the setup 
is made, the reconstruction must be valid for any 
object. This means that one can modify all the op¬ 
tical elements in the object half space (object and 
object location, direction and curvature of the il¬ 
lumination beam), but the optical elements in the 
image half space must remains unchanged. 

The reconstruction methods mentioned above 
(Hi-Ill made reconstruction in the image half 
space. This means that the image of the object in 
plane O is reconstructed by propagating the holo¬ 
gram over a distance d from C to O. This propaga¬ 
tion is calculated in free space, by using either the 
one Fourier Transform (1-FFT) method [I[], or the 
angular spectrum (2-FFT) method [3|. However, 


reconstruction in the image half space becomes dif¬ 
ficult when varying the location of the object along 
z', or when imaging thick objects. Indeed, the loca¬ 
tion of the image O and the reconstruction distance 
d — |CO| strongly depend on the object location 2 :', 
which complexifies the reconstruction process. If 
the object is located near plane C’, which is imaged 
by MO on the camera (i.e. on plane C), we get d ~ 
0. The 2-FFT reconstruction method, which is well 
suited to small d, should thus be preferred. Con¬ 
versely, if the object is close to the MO focal plane, 
we get d ^ 00 , and the 1-FFT method should be 
used. This point tends to be problematic if we con¬ 
sider reconstruction of both amplitude and phase 
of of the light scattered by a thick 3D sample, or if 
one want to measure the wave field. As a matter of 
fact, it prevents experimental setup calibration to 
remain valid for the entire sample thickness. Mak¬ 
ing the setup calibration independent of the sample 
position according to MO is therefore an issue to 
tackle. 

Here, we propose to consider that the recorded 
signal \E + ErI^^ represents the hologram H' of the 
field scattered by the object in the plane of the 
image of the camera (i.e. in plane C’). The re¬ 
construction is therefore made in the object half 
space, by propagating hologram H' over a distance 
d' = jc’O’l from plane C’ to plane O’. Since d' is 
always small (a few microns), the 2-FFT methodj^ 
is well adapted in all cases (d 0 or d 00 ), 
which notably simplifies reconstruction algorithms. 
Moreover, if the calibration is done well, this recon¬ 
struction can be made with orthogonal x', y' and 
z' axes, while keeping constant the pixel pitches in 
the x' and y' axes. 

2. Calculation of the hologram of the field in 
plane C' 

The hologram H recorded by the camera in plane 
C is: 

h = \e + Er\^ (1) 

= \E\^ + \Er\^ + EE*r + E*Er 

where E and Er are the signal and reference fields 
in plane C. Because of the microscope objective 
MO, the curvature of the reference field and the 
off axis angular tilt, the phase of H in plane C is 
not equal to the phase of the signal field in cam¬ 
era conjugate plane C’, from which the object half 
space reconstruction will be made. Moreover, the 
+1 grating order term EE^ that is proportional to 
the field E must be selectively filtered. To perform 
the reconstruction from the field E in plane C’, it is 
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thus necessary to manipulate the data to compen¬ 
sate for these phase effects and to select the 
term that is proportional to E [18|. This manipula¬ 
tion of the data must be made with few calibration 
parameters that characterize the optical elements 
of the image half space part of the setup, and that 
do not depends on the the object i.e. on the optical 
elements of the object half space. 


2.A. The phase curvature in the camera plane 
C 

Let us analyze first the phase curvature of EE"^ 
in plane C. For that purpose, we will consider a 
“gedanken experiment” without object in which 
the illumination beam is plane wave beam oriented 
along the optical axis z'. The field E is thus flat in 
plane C’. 

This plane wave is focused by MO at point P in 
the MO pupil plane. The signal complex field E 
exhibit thus a phase factor equal to 
where A; = 27r/A is the modulus of the wavevec- 
tor in air, and where r is the radius of curvature 
of the wavefront that is equal to the MO pupil to 
camera distance r = |PC|. Similarly, the phase 
of the complex conjugate of the reference field E"^ 
is where E = |RC| is the radius 

of curvature of En (with r' = oo if the reference 
beam is a plane wave). This means that the phase 
of the -hi grating order term EE^ in plane C is 
^-^jk{x^^y^)/2r" — Yjr — IjE. 


2.B. Phase curvature correction by reconstruc¬ 
tion of the MO pupil 

Let us reconstruct the image Hi{kx^ ky) of the MO 
pupil by using the 1-FFT method or Fourier recon¬ 
struction method[I|. We have thus: 


^i(fc„A;^) = FFT 


^-jk{x‘^+y‘^)/2r" 


H{x,y) 


( 2 ) 


where e jg equal to e x 

^-^jk{x‘^^y‘^)/2r' ^ phase factor 

is the 1-FFT propagation kernel over a distance r, 
while the second factor +y )/2r compensates 

the curvature of E"^. Since the back focal point P is 
located within the MO pupil plane, the propagation 
distance r is equal to |PC|. This means that the 
reconstruction phase factor exactly 

compensates the phase curvature of 

EE"^ calculated in section 12.Al . 

To determine r", we propose to reconstruct the 
MO pupil images \Hi\^ by adjusting r" so as to ob¬ 
tain the sharpest image of the pupil edge. Since the 
we have validated our reconstruction with a USAF 



Fig. 2. (a) Reconstructed USAF target hologram in the 

pupil plane Hi{kx,ky) (1024 x 1024 pixels), (b) Zoom 
of the +1 grating order of (512 x 512 pixels), (c) Pupil 
image obtained with ground glass imaged with an x 10 
MO. (d) Fourier space filtered hologram H 2 {kx^ky) of 
the +1 grating order made with a circular crop of the 
MO pupil image (radius r/c=162 pixels) followed by a 
translation of the selected zone in the center of the 
Fourier space, (e) Spatially filtered hologram 
with proper phase correction. Arbitrary scale brightness 
is color is phase i.e. argilA.... 


target located in near plane C’, we have reconstruct 
the pupil image \Hi{kx^ ^y)l^ obtained with the tar¬ 
get in plane C’, and displayed it on Fig 12 (a). 3 
bright zones corresponding the +1,-1 and zero grat¬ 
ing orders are visible. These zones are separated 
because of the off axis tilt angle. Here, the recon¬ 
struction parameter r" has been properly adjusted, 
and the pupil edge of the +1 grating order zone is 
sharp as seen on the zoom displayed on Figl2] (b). 

Nevertheless, the pupil edge is dark on FigI2] (a) 
and (b), because the USAF target scatters light 
over quite narrow angles. The adjustment of r" 
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is thus quite difficult. It is easier to adjust r" with 
an object that scatters more light, like a ground 
glass located in front of MO. Figure [2] (c) shows an 
example of a pupil reconstruction made with such 
a ground glass. Let us notice here that the adjust¬ 
ment of r" can be made with the object of interest 
itself without any previous calibration of the setup. 
This has been done in (^ . 

2.C. Spatial filtering and off axis phase correc¬ 
tion 

To perform the spatial filtering that selects 
and to compensate the off axis angular tilt, we 
propose to crop the data within the circular MO 
pupil image (which is sharp), and to translate the 
cropped zone to the center of the calculation grid. 
The spatial filtering is made by the crop, while the 
off axis compensation is made by the translation. 

The filtered and phase-corrected hologram of the 
pupil in the Fourier space H 2 is thus: 

H2{Ky) = -h dk^y) if |k^y| < Vk 

= 0 if not (3) 

where kxy = {kx^ky)^ dkxy is the translation that 
moves the -hi pupil image in the center of the 
Fourier space, and the pupil radius. The cor¬ 
responding real space hologram H 2 is: 


G 1 is the MO transverse gain from plane C’ to 
plane C). We have thus: 

H[Sx\y') = H,„{x,y) (5) 

= H...{k,,ky) 

with x' = xjG^ y' = yjG ^ k'x = kxG and ky = kyG. 

3. Reconstruction of the field in any plane 
3.A. Reconstruction in the object half space 

We have calculated the phase-corrected hologram 
H 2 in plane C’ in section [2] by EqjHand EqjSl The 
image H'^{x'^y'^ z') of the object in any z' plane 
is reconstructed by using the 2-FFT reconstruction 
method (also known as the convolution method) 
from H 2 {x'^y'). Since H 2 = FFT(iL 2 ), we have: 


H',{x',y',z') = 


FFT 


-1 


fc;)l (6) 


where jg the 2-FFT propagation 

kernel over distance z'. The origin z' — {) corre¬ 
sponds thus to plane C’. Note that since propaga¬ 
tion from C’ to O’ takes place in a medium (air, 
water or oil) of refractive index rim, k has been re¬ 
placed by /cm = n^k in the propagation kernel. 


H2{x,y)=FFT-^ 


H2{kx’) ky) 


( 4 ) 


where FFT“^ is the reverse 2D Fourier transform. 

We have displayed \H 2 {x^y)\‘^ on Fig. [2](e) with 
phase displayed with color. Since the USAF target 
is located in plane C’, the image of the target is 
sharp. Moreover the phase, which is displayed in 
color, is the same in all point of the image, like the 
phase of the field E in plane C’. This means that 
the phase has been properly corrected. 


2.D. Object/image half space holograms 

In the previous calculation, the holograms iL, iLi, 
H 2 ••• are matrices of data, that represent the field 
either in the image or the object half space. 

To avoid any confusion, we will consider that iL, 
iLi, H 2 ... are the holograms, and x^y^kx^ky the 
coordinates in the image half space. The pitch is 
Ax for X and ?/, and A/c = 27v/{NAx) for kx and 
ky (where Ax is the camera pixel size, and N the 
size of the calculation grid) . 

On the other hand, H'^ H[^ H 2 ... are the holo¬ 
grams, and x'^y'^k'^ and ky the coordinates in the 
object half space. The pitch is A'x — A'xjG for 
x' and y' ^ and A!k — GA!k for k'^ and ky (where 


3.B. Reconstruction in the image half space 

Equation ([5]) makes the correspondance of the holo¬ 
grams iL... and H' in planes C and C’. It can be 
generalized for any plane by: 

H[^{x',y',z')^H,Sx.y.z) (7) 

H'^Xk',,k'y,z') = H,,Xk..ky,z) 

where z is a formal coordinate that is not equal 
to d = |CO|. We can now calculate H^{x^y^z) by 
using a relation formally equivalent to Eq. (j6j) . We 
get: 

( 8 ) 

Since propagation in image half space is made in air, 
we have chosen in Eq. (|Hj) a propagation kernel that 
involves k (instead of fcm). Equations (|6j) and (|8j) 
yield exactly the same calculations on the discrete 
data of the calculation grid if we have 

z = z'G^ lum (9) 

This equation defines the formal coordinate 2 ;. 
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Fig. 3. Reinterpretation of the holographic microscopy 
setup. USAF: USAF target located in plane O’; MO: 
microscope objective; NL: numerical lens of focal r lo¬ 
cated in the camera plane C; MO + NL: afocal optical 
device that images the USAF target in plane O”. 


3. C. The afocal device that makes the recon¬ 
structions in the object and image half space 
equivalent 

The reconstruction made in the image half space 
by Eq. [8] and Eq. [9] can be reinterpreted quite 
simply. The phase curvature of the reference beam 
(phase factor combined with the nu¬ 
merical phase factor used to image 

the MO pupil (and to correct the phase in plane 
C’) is equivalent to a Numerical Lens (NL) of focal 
length r (phase factor located in the 

camera plane C (see Fig. [3j). Since the MO and NL 
have a common focal point P, MO and NL form 
an afocal optical device, with an overall transverse 
gain G and a longitudinal gain Performing 

the reconstruction either in the object or image half 
space is thus totally equivalent. 

The reconstruction made in the image half space 
with the afocal optical device is close to the recon¬ 
struction called ’’Image Plane Approach” by Mon¬ 
fort et al. [l^. Nevertheless, these authors consider 
a varying magnification factor, which involves ex¬ 
plicitly the size of the image of the object in plane 
O, and which depends strongly on the location of 
the object. But the varying Monfort et al. magnifi¬ 
cation and the varying object magnification (plane 
O’ to image plane O: see FigH]) compensate yield¬ 
ing a constant magnification (object in plane O’ to 
reconstructed image in plane O”: see FigjSj), which 
is simply equal to G. 

4. Experimental validation 

To validate our reconstruction method, we have 
made a test experiment with a A =785 nm laser 


(Sanyo DL-7140-201) by imaging an USAF target 
with an oil immersion (n^ = 1.518) Microscope Ob¬ 
jective MO (NA=1.4 x60) and a holographic setup 
built by modifying a commercial upright micro¬ 
scope. A detailed description of the setup is given 
in reference [^. The holograms are recorded for 
m — 0...59 different positions of the target along 
z', the positions being adjusted manually with steps 
of Az' = 2.5 /im. The sharpest image (nearly fo¬ 
cused without any correction) corresponds to loca¬ 
tion m = 29. The holograms are recorded with 
a PCO Pixelfly camera (1280 x 1024 square pixels 
of size Ax = 6.7 /im), and the measured data are 
cropped into a 1024 x 1024 calculation grid. 


Fig. 4. (a) Reconstructed hologram iLg of the USAF 

target for positions m = 29 made with z' = 0 (a), and 
m = 0 with z' — 72.5/im (b). Arbitrary scale bright¬ 
ness is intensity i.e. color is phase i.e. argiLg. 

The white dashed line rectangles (517 x 567 pixels) seen 
are visual guides, whose sizes are exactly the same size, 
and positions slightly shifted. 

The hologram H'^ of the USAF target at position 
m = 29 is displayed on Fig. 0] (a). Since the USAF 
target is nearly focused without any correction, re¬ 
construction is made with z' = 0. Moreover, since 
the phase correction has been made, the phase of 
the illumination beam is flat i.e. the color is ap¬ 
proximately the same within the whole USAF tar¬ 
get. We have then used the m — 29 USAF image, 
which is sharp, to calibrate G. We got G = 74.61. 

We have then reconstructed the USAF target for 
every position, from m = 0 to m = 59. Figure [4| 
(b) shows for example the USAF image for position 
m = 0. As expected, the size and location of the 
USAF image remains the same, showing that the x 
and y scales are conserved. This can be verified by 
comparing Fig. [4] (a) and (b). For positions m = 0 
(corresponding to z' —72.5 /im) and m — 29 
[z' ~ 0), the size of the USAF target is exactly 
preserved (see white dashed rectangle) while the 
position is slightly shifted. 
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Fig. 5. Reconstruction distances z'^ and Zm as function 
of the USAF target location m (red points) and best 
linear fit (black solid line). 


For each position m, we have reconstructed the 
hologram ^ z'^) by adjusting (or Zm) so 

as to obtain the sharpest image. As the USAF 
target is an “amplitude object”, we have adjust 
by using the ’’focus plane detection criteria” 
of Dubois et al. 0- Since the position and size 
of the image remain the same, this automatic ad¬ 
justment of z'^ works well. Figure [5] shows the re¬ 
construction distances z'^ obtained by this method. 
As can be seen, z'^ varies linearly with m with 
a slope dz'^/dm = —2.56 /im which corresponds 
to the mechanical displacement, and with an off¬ 
set m — 28.97 that is nearly equal to the location 
m = 29, where the USAF target is on focus on the 
camera. 

5. Remark on the calibration of the setup 

In section [27^ we have calibrated the setup i.e. de¬ 
termine r" and d\^xy by reconstructing the image of 
the pupil with an object that scatters enough light. 
r" is adjusted to get the sharpest pupil edges, and 
dkxy by translating the pupil in the center of the 
Fourier space. 

In section 01 we have seen that the the size and 
location (in x and y directions) of the reconstructed 
image of the USAF target do not change by moving 
the target along z'. This property provides a second 
calibration method. One can move an object along 
the z' direction and consider 2 different positions 
the object, for example z' — —72.5/im, and z' = 0. 
One can then record the holograms and reconstruct 
the images of the object for these 2 positions, as 
done in FigH] (a) and (b). One can then adjust r" 
in order to get the same size for the 2 reconstructed 


images, and adjust and d\^xy lo get the same posi¬ 
tions. In the example of FigHJ the adjustment of 
r" is nearly perfect (since the USAF sizes are ex¬ 
actly the same on (a) and (b) ), while the adjust¬ 
ment of d\^xy could be improved (since the positions 
are slightly shifted). Our experience is that second 
calibration method (size and position of 2 recon¬ 
structed images with different z') yields more pre¬ 
cise calibration than the hrst method (pupil sharp¬ 
ness and pupil translation). 

The two proposed calibration methods do not re¬ 
quire a flat phase illumination like the methods 
based on the phase flatness of the reconstructed 
image 0- Note also that the reconstruction di¬ 
rection z' depends on the calibration method which 
is used to get d\<ixy If fhe phase flatness is used, the 
z' axis is the direction of the illumination beam. If 
the translation of pupil image is used (hrst calibra¬ 
tion method), z' is parallel to the line that joins the 
pupil center to the camera center. If the position of 
reconstructed image of the object (USAF target) 
is used (second calibration method), z' is parallel 
with the 2 ; motion. This last method is the best 
method when a modihed commercial microscope is 
used to make holography, since the z' axis coincides 
with the microscope 2 ; axis. 

6. Remark on construction with tube lens 

Ah the results presented here remains valid when 
a tube lens placed between the pupil P and the 
beam splitter BS2. In the ’’gedanken experiment” 
with a plane wave illumination beam, the tube lens 
changes the curvature of the held E in plane C , 
i.e. r. The calibration parameter r"^ and the NL 
focal lens r are thus both changed. By using the 
second calibration method, r" is adjusted so that 
the size of the reconstructed image object is not 
dependent on the object position z'. This means 
that the ensemble of lenses MO-htube lens-h NL 
still constitute an afocal device, with transverse and 
longitudinal magnihcations G and G‘^ jrim- 

7. Conclusion 

We have proposed a holographic microscopy recon¬ 
struction method which propagates the hologram in 
the object half space, in the vicinity of the object. 
Since the reconstruction phase, the reference phase 
curvature and MO form an afocal device, the re¬ 
construction can be interpreted as occurring equiv¬ 
alently in the object or in image half space. 

The reconstruction method has been validated 
with a USAF target which has been imaged with a 
high numerical aperture microscope objective MO 
for different locations of the target along the Ion- 
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gitudinal axis z'. We have verified that the recon¬ 
struction is made with orthogonal axes x', y' and 
2 :', and that the pixel pitches x', y' and z' do not 
depend on the USAF target location. The experi¬ 
mental test has been made with a plane illumina¬ 
tion beam oriented along the 2 : axis, and we have 
verify that the reconstructed phase (colors on Fig. 
m (a) and (b) ) varies slowly with x^y. The pro¬ 
posed reconstruction is comnatible with spherical 
or dark field illumination (22l-[^. 


Two calibration methods, which do not require 
plane wave illumination have been proposed. The 
first method is based on the reconstruction of the 
MO pupil, with an object that scatters light. This 
method can be used with holograms of interest 
which have recorded without proper calibration of 
the setup, and has been used in that case [231]. The 
second method, which is more precise, requires to 
translate an object along the z' axis and to record 
two holograms for two different z'. 
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